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Abstract 

Voting is a simple mechanism to aggregate the pref- 
erences of agents. Many voting rules have been 
shown to be NP-hard to manipulate. However, a 
number of recent theoretical results suggest that 
this complexity may only be in the worst-case since 
manipulation is often easy in practice. In this pa- 
per, we show that empirical studies are useful in 
improving our understanding of this issue. We 
demonstrate that there is a smooth transition in the 
probability that a coalition can elect a desired can- 
didate using the veto rule as the size of the manipu- 
lating coalition increases. We show that a rescaled 
probability curve displays a simple and universal 
form independent of the size of the problem. We 
argue that manipulation of the veto rule is asymp- 
totically easy for many independent and identically 
distributed votes even when the coalition of ma- 
nipulators is critical in size. Based on this argu- 
ment, we identify a situation in which manipula- 
tion is computationally hard. This is when votes 
are highly correlated and the election is "hung". 
We show, however, that even a single uncorrelated 
voter is enough to make manipulation easy again. 



1 Introduction 

The Gibbard-Satterthwaite theorem proves that, under some 
simple assumptions, most voting rules are manipulable. That 
is, it may pay for an agent not to report their preferences truth- 
fully. One possible escape f rom this result was pr oposed by 
Bartholdi, Tovey and Trick jBartholdi et al, 1989| . Whilst 



Conitzer et al, 2007) . There is, however, increasing con- 



a manipulation may exist, perhaps it is computationally too 
difficult to find. Many results have subsequently been proven 
showing that various voting rules are NP-hard to manipulate 
under different assumptions including: an unbounded num- 
ber of candidates; a small number of candidates but weighted 
votes; and uncertainty in the distribution of votes. See, for 
instance, OBartholdi et al, 19891 iBartholdi and Orlin, 1991 
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cern that worst-case results like these may not reflect the 
difficulty of manipulation in practice. Indeed, a number of 
recent theoretical results sug gest that manipulation may of- 
ten be computationally easy jConitzer and Sandholm, 2006 



Procaccia and R osenschein, 2007b ; Xia and Conitzer, 2 008a 



Friedgut et al, 2008||Xia and Conitzer, 2008b| 

In this paper we show that, in addition to attacking this 
question theoretically, we can profitably study it empirically. 
There are several reasons why empirical analysis is useful. 
First, theoretical analysis is often asymptotic so does not 
show the size of hidden constants. In addition, elections are 
typically bounded in size. Can we be sure that asymptotic be- 
haviour is relevant for the finite sized electorates met in prac- 
tice? Second, theoretical analysis is often restricted to partic- 
ular distributions (e.g. independent and identically distributed 
votes). Manipulation may be very different in practice due to 
correlations between votes. For instance, if all preferences 
are single-peaked then there are voting rules which cannot be 
manipulated. It is in the best interests of all agents to state 
their true preferences. Third, many of these theoretical re- 
sults about the easiness of manipulation have been hard won 
and are limited in their scope. For instance, Friedgut et al. 
were not able to exte nd their result beyond three candidates 

1 Friedgut et al, 2008 1. An empirical study may quickly sug- 
gest if the result extends to more candidates. Finally, empir- 
ical studies may suggest new avenues for theoretical study. 
For example, the experiments reported here suggest a simple 
and universal form for the probability that a coalition is able 
to elect a desired candidate. It would be interesting to try to 
derive this form theoretically. 

2 Background 

We suppose that there are n agents who have voted and a 
coalition of m additional agents who wish to manipulate the 
result. When the manipulating coalition is small, they have 
too little weight to be able to change the result. On the other 
hand, when the coalition is large, they are sure to be able 
to make their desired candidate win. Procaccia and Rosen- 
schein proved that for most scoring rules and a wide variety 
of distributions over votes, when m = o(y / n), the probability 
that a manipulating coalition can change the result tends to 0, 
and when m = uj{s/n), the probability that they can manipu - 
late the result tends to 1 iProcaccia and Rosenschein, 2 007a I. 



They offer two interpretations of this result. On the positive 
side, they suggest it may focus attention on other distributions 
which are computationally hard to manipulate. On the neg- 
ative side, they suggest that it may strengthen the argument 
that manipulation problems are easy on average. 

More recently, Xia and Conitzer have shown that for a large 
class of voting rules, as the number of agents grows, either the 
probability that a coalition can manipulate the result is very 
small (as the coalition is too small), or the probability that 
they can easily m anipulate the result to m ake any alternative 
win is very large 1 Xia and Conitzer, 2008a) . They leave open 
only a small interval in the size of the coalition for which the 
coalition is large enough to be able to manipulate but not ob- 
viously large enough to be able to manipulate the result eas- 
ily. More precisely, for a wide range of voting rules includ- 
ing scoring rules, STV, Copeland and maximin, with votes 
which are drawn independently and with an identical distri- 
bution that is positive everywhere, they identify three cases: 

• if m = 0(n p ) for p < | then the probability that the 
result can be changed is 0(^=); 

• if m — Q(n p ) forp > \ and o(n) and votes are uniform 
then the probability that the result can be manipulated is 
1 — 0(e~ e (™ P )) using a simple greedy procedure; 

• if in — <d(y/n) then they provide no result. 

In this paper, we shall provide empirical evidence to help 
close this gap and understand what happens when the coali- 
tion is of a critical size that grows as 6(y / n). 

3 Finding manipulations 

We focus on the veto rule. This is a scoring rule in which each 
agent gets to cast a veto against one candidate. The candidate 
with the fewest vetoes wins. We suppose that tie-breaking is 
in favor of the manipulators. However, it is easy to relax this 
assumption. There are several reason why we start this in- 
vestigation into the complexity of manipulation with the veto 
rule. First, the veto rule is very simple to reason about. This 
can be contrasted with other voting rules that are computa- 
tionally hard to manipul ate. For example, the STV rule is 
NP-hard to manipulate iBartholdi and Orlin, 19911 but this 
complexity appears to come from reasoning about what hap- 
pens between the different rounds. Second, the veto rule is 
on the borderline of tractability since constructive manipula- 
tion of the rule by a coalition of weighted a gents is NP-hard 
but de structive manipulation is polynomial [Conitzer et al, 
2007|. Third, as the next theorem shows, number partitioning 
algorithms can be used to compute a successful manipulation 
of the veto rule. More precisely, manipulation of an elec- 
tion with 3 candidate s and weighted votes (which is NP-hard 
I Conitzer et al. , 2007|) can be directly reduced to 2-way num- 



ber partitioning. We therefore compute manipula tions in ou r 
experiments using the efficient CKK algorithm ]Korf, 1995| . 

Theorem 1 There exists a successful manipulation of an 
election with 3 candidates by a weighted coalition using the 
veto rule iff there exists a partitioning of W U {\a — b\} into 
two bags such that the difference between their two sums is 



less than or equal to a+b — 2c+^2 ieW i where W is the mul- 
tiset of weights of the manipulating coalition, a, b and c are 
the weights of vetoes assigned to the three candidates by the 
non-manipulators and the manipulators wish the candidate 
with weight c to win. 

Proof: It never helps a coalition manipulating the veto rule 
to veto the candidate that they wish to win. The coalition 
does, however, need to decide how to divide their vetoes be- 
tween the candidates that they wish to lose. Consider the 
case a > b. Suppose the partition has weights w — A/2 



and w + A/2 where 2w = J2iewu{\a-b\} * anc ^ ^ ls me 
difference between the two sums. The same partition of ve- 
toes is a successful manipulation iff the winning candidate 
has no more vetoes than the next best candidate. That is, 
c < b + (w - A/2). Hence A < 2w + 26 - 2c = 



(a-b) + 2b-2c + J2 



(a + b-2c) + 2j: iew 



i. In 
i. Thus 



the other case, a < b and A < (b + a — 2c) + 

A <a + b-2c + J2 ie w i - D 

Similar arguments can be given to show that the manip- 
ulation of a veto election of p candidates can be reduced to 
finding a p — 1-way partition of numbers, and that manipula- 
tion of any scoring rule with 3 candidates and weighted votes 
can be reduced to 2-way number partitioning. However, ma- 
nipulating elections with greater than 3 candidates and scor- 
ing rules other than veto or plurality appears to require other 
computational approaches. 

4 Uniform votes 

We consider the case that the n agents veto uniformly at 
random one of the 3 possible candidates, and vetoes carry 
weights drawn uniformly from (0, k}. When the coalition is 
small in size, it has too little weight to be able to change the 
result. On the other hand, when the coalition is large in size, 
it is sure to be able to make a favored candidate win. There 
is thus a transition in the manipulability of the problem as the 
coalition size increases (see Figure[T]l. 

Based on iProcaccia and R osenschein, 2007 a| Xia and 
Conitzer, 2008a[ , we expect the critical coalition size to in- 
crease as ^Jn. In Figure |2j we see that the phase transition 
displays a simple and universal form when plotted against 
m/y/n. The phase transition appears to be smooth, with the 
probability varying slowly and not approaching a step func- 
tion as problem size increases. We obtained a good fit with 
1 — §e - " 1 / v/ ™. Other smooth phase transitions have been seen 
with 2-coloring l Achlioptas, 1999|, l-in-2 satisfiability and 
Not- All-Equal 2-satisfiability I jWalsh, 2002[ . It is interesting 
to note that all these decision problems are polynomial. 

The theoretical results mentioned earlier leave open how 
hard it is to compute whether a manipulation is possible when 
the coalition size is critical. Figure [3] displays the com- 
putational cost to find a manipulation (or prove none ex- 
ists) using the efficient CKK algorithm. Even in the crit- 
ical region where problems may or may not be manipula- 
ble, it is easy to compute whether the problem is manipu- 
lable. All problems are solved in a few branches. This con- 
trasts with phase transition behaviour in problems like sat- 
isfiability jCheeseman et al, 199lj |Mitchell et al, 1992 ' 
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Figure 1: Probability of a coalition of to agents electing a 
chosen candidate where n agents have already voted. Vetoes 
are weighted and uniformly drawn from (0,2 8 ]. At to = 0, 
there is a l/3rd chance that the non-manipulators have already 
elected this candidate. In this and all subsequent experiments, 
we tested 10,000 problems at each data point. 




Figure 2: Rescaled probability that a coalition of m agents 
can elected a chosen candidate where n agents have already 
voted. Vetoes are weighted and uniformly drawn from (0, 2 8 ]. 
The x-axis is scaled by 1 /y/n. 



Gent and Walsh, 19 941, cons traint satisfaction ||Gent et al. 
19951, number p artitioning ||Gent and Walsh, 1996a[ |Gent 



and W alsh, 1998| and the traveling salesman problem [Gent 
and Walsh, 1996b I where the hardest problems occur around 
the phase transition. 

5 Why hard problems are rare 

Based on our reduction of manipulation problems to num- 
ber partitioning, we give a heuristic argument why hard ma- 
nipulation problems become vanishing rare as n oo and 
to = 0(y / n). The basic idea is simple: by the time the coali- 
tion is large enough to be able to change the result, the vari- 
ance in scores between the candidates is likely to be so large 
that computing a successful manipulation or proving none is 
possible will be easy. 

Suppose that the manipulators want candidates A and B 



Figure 3: Computational cost for the CKK algorithm to de- 
cide if a coalition of m agents can manipulate a veto election 
where n agents have already voted. Vetoes are weighted and 
uniformly drawn from (0, 2 m \. All problems are solved with 
little search. 



to lose so that C wins, and that the non-manipulators have 
cast vetoes of weight a, b and c for A, B and C respectively. 
Without loss of generality we suppose that a > b. There are 
three cases to consider. In the first case, a> c and b > c. It is 
then easy for the manipulators to make C win since C wins 
whether they veto A or B. In the second case, a > c > b. 
Again, it is easy for the manipulators to decide if they can 
make C win. They all veto B. There is a successful manipu- 
lation iff C now wins. In the third case, a < c and b < c. The 
manipulators must partition their m vetoes between A and B 
so that the total vetoes received by A and B exceeds those 
for C. Let d be the deficit in weight between A and C and 
between B and C. That is, d = (c—a) + (c—b) = 2c— a — b. 
We can model d as the sum of n random variables drawn uni- 
formly with probability 1/3 from [0, 2k] and with probability 
2/3 from [— k, 0). These variables have mean and variance 
2fc 2 /3. By the Central Limit Theorem, d tends to a normal 
distribution with mean 0, and variance s 2 = 2nk 2 /3. For a 
manipulation to be possible, d must be less than w, the sum 
of the weights of the vetoes of the manipulators. By the Cen- 
tral Limit Theorem, w also tends to a normal distribution with 
mean /i = mk/2, and variance a 2 = 2mk 2 /3 



A simple heuristic argument due to |Karmarkar et al., 
19861 and also based on the Central Limit Theorem upper 
bounds the optimal partition difference of to numbers from 
(0, k] by 0(ky/m/2 m ). In addi tion, based on the phase tran- 
sition in number partitioning I Gent and Walsh, 19981, we 
expect partitioning problems to be easy unless log 2 (fc) = 
0(to). Combining these two observations, we expect hard 
manipulation problems when < w — d < a^/m for some 
constant a. The probability of this occurring is: 



dy dx 



2-nu 



x—ot\/7n 



2lTS 



By substituting for s, /i and a, we get: 



o -\/47rTOfc 2 /3 



x—a^/rn 



e 4 ™ fc2 /3 dydx 



For n ~> oo, this tends to: 

I (a,-mk/2) 2 
p 4mt ! /3 

x /47rmfc 2 /3 



As e 



v/47mfc 2 /3 
< 1 for 2 > 0, this is upper bounded by: 



2 /3 dx 



y/4irnk 2 /3 Jo v /4 7 rmfc 2 /3 



= 0(-y/n) and 



Since the integral is bounded by 1, m 
log 2 (fc) = <d(m), this upper bound varies as: 

Thus, we expect hard instances of manipulation problems to 
be exponentially rare. Since even a brute force manipula- 
tion algorithm takes 0(2 m ) time in the worst-case, we do not 
expect the hard instances to have a significant impact on the 
average-case as n (and thus m) grows. We stress this is only a 
heuristic argument. It makes assumptions about the complex- 
ity of manipulation problems (in particular that hard instances 
should lie within the narrow interval < w — d < a^fm). 
These assumptions are currently only supported by empirical 
observation and informal argument. However, the experimen- 
tal results reported in Figure [3]support these conclusions. 

6 Varying weights 

The theoretical analyses of manipulation in iProcaccia and 



ine theoretical analyses or manipulation in Ifrocaccia ana 
Rosenschein, 2007a; Xia and Conitzer, 2008a I suggest that 
the probability of an election being manipulable is largely in- 
dependent of k, the size of the weights attached to the vetoes. 
Figure [4] demonstrates that this indeed appears to be the case 
in practice. When weights are varied in size from 2 s to 2 16 , 




m/sqrt(n) 

Figure 4: Independence of the size of the weights and the ma- 
nipulability of an election. Probability that a coalition of m 
agents can elect a chosen candidate where n agents have al- 
ready voted. Vetoes are weighted and uniformly drawn from 

(o,4 

the probability does not appear to change. In fact, the prob- 
ability curve fits the same simple and universal form plotted 
in Figure [2] We also observed that the cost of computing a 
manipulation or proving that none is possible did not change 
as the weights were varied in size. 



7 Normally distributed votes 

What happens with other distributi ons of votes? The theoret- 
ical analyses of manipulation in jProcaccia and Rosenschein, 
2007a; [Xia and Conitzer, 2008a[ suggest that there is a criti- 
cal coalition size that increases as Q(y/n) for many types of 
independent and identically distributed random votes. Sim- 
ilarly, our heuristic argument about why hard manipulation 
problems are vanishingly rare depends on application of the 
Central Limit Theorem. It therefore works with other types 
of independent and identically distributed random votes. 
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Figure 5: Weighted votes taken from a normal distribution. 
We plot the probability that a coalition of m agents can elect 
a chosen candidate where n agents have already voted. Vetoes 
are weighted and drawn from a normal distribution with mean 
2 s and standard deviation 2 7 . The x-axis is scaled by %fn. 

We shall consider therefore another type of independent 
and identically distributed vote. In particular, we study an 
election in which weights are independently drawn from a 
normal distribution. Figure [5] shows that there is again a 
smooth phase transition in manipulability. We also plotted 
Figure|5 on top of Figures |2]and|4] All curves appear to fit the 
same simple and universal form. As with uniform weights, 
the computational cost of deciding if an election is manip- 
ulable was small even when the coalition size was critical. 
Finally, we varied the parameters of the normal distribution. 
The probability of electing a chosen candidate as well as the 
cost of computing a manipulation did not appear to depend 
on the mean or variance of the distribution. 

8 Correlated votes 

We conjecture that one place to find hard manipulation prob- 
lems is where votes are more correlated. For example, con- 
sider a "hung" election where all n agents veto the candidate 
that the manipulators wish to win, but the m manipulators 
have exactly twice the weight of vetoes of the n agents. This 
election is finely balanced. The favored candidate of the ma- 
nipulators wins iff the manipulators perfectly partition their 
vetoes between the two candidates that they wish to lose. In 
Figure [6] we plot the probability that the m manipulators can 
make their preferred candidate win in such a "hung" election 
as we var y the size of their weight s k. Similar to number par- 
titioning [ Gent and Walsh, 1998) , we see a rapid transition 
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Figure 6: Manipulation of an election where votes are highly 
correlated and the result is "hung". We plot the probability 
that a coalition of m agents can elect a chosen candidate. Ve- 
toes of the manipulators are weighted and uniformly drawn 
from (0, k], the other agents have all vetoed the candidate that 
the manipulators wish to win, and the sum of the weights of 
the manipulators is twice that of the non-manipulators. 



Figure 7: The cost to decide if a hung election can be manip- 
ulated. We plot the cost for the CKK algorithm to decide if a 
coalition of m agents can manipulate a veto election. Vetoes 
of the manipulators are weighted and uniformly drawn from 
(0, k], the other agents have all vetoed the candidate that the 
manipulators wish to win, and the sum of the weights of the 
manipulators is twice that of the non-manipulators. 



in manipulability around log 2 (fc)/ m w 1. In Figure [7] we 
observe that there is a rapid increase in the computationally 
complexity to compute a manipulation around this point. 

What happens when the votes are less correlated? We con- 
sider an election which is perfectly hung as before except for 
one agent who votes at random between the three candidates. 
In Figure [8] we plot the cost of computing a manipulation as 
the weight of this single random veto increases. Even one un- 
correlated vote is enough to make manipulation easy if it has 
the same magnitude in weight as the vetoes of the manipula- 
tors. This suggests that we will only find hard manipulation 
problems in when votes are highly correlated. 

9 Other related work 

There have been a number of other recent theoretical results 
about the computational complexity of manipulating elec- 
tions. For instance, Procaccia and Rosenschein give a simple 
greedy procedure that will find a manipulation of a scoring 
rule for any "junta" distribution of weighted votes in polyno- 
mial time wi th a probability of failure that is an in verse poly- 
nomial in n UProcaccia and Rosenschein, 2007b| . A "junta" 
distribution is concentrated on the hard instances. 

As a second example, Friedgut, Kalai and Nisan prove that 
if the voting rule is neutral and far from dictatorial and there 
are 3 candidates then there exists an agent for who m a ran 



dom manipulation succeeds with probability O.(-) [Friedgut 
20081. Xia and Conitzer showed that, starting from 



et al. 



different assumptions, a random manipulation would succeed 
with probability 0(— ) for 3 or more candidates for STV, for 
4 or more candidates for any scoring rule and for 5 or more 
candidates for Copeland I Xia and Conitzer, 2008b I. 

Coleman and Teague provide polynomial algorithms to 
compute a manipulation for the STV rule when eith er the 
number of voters or the number of candidates is fixed lCole-| 
man and Teague, 20071. They also conducted an empirical 



study which demonstrates that only relatively small coalitions 
are needed to change the elimination order of the STV rule. 
They observe that most uniform and random elections are not 
trivially manipulable using a simple greedy heuristic. 

Finally, similar phenomena have been observe d in the 
phase transition for the Hamiltonian cycle pro blem 1 Frank et\ 



al, 1998 



Vandegriend and Culberson, 19981. If the number 



of edges is small, there is likely to be a node of degree smaller 
than 2. There cannot therefore be any Hamiltonian cycle. By 
the time that there are enough edges for all nodes to be of 
degree 2, there are likely to be many possible Hamiltonian 
cycles and even a simple heuristic can find one. Thus, the 
phase transition in the existence of a Hamiltonian cycle is not 
associated with hard instances of the problem. The behavior 
seen here is similar. By the time the coalition is large enough 
to manipulate the result, the variance in scores between the 
candidates is likely to be so large that computing a successful 
manipulation or proving none is possible is easy. 

10 Conclusions 

We have studied whether computational complexity is a bar- 
rier to the manipulation for the veto rule. We showed that 
there is a smooth transition in the probability that a coali- 
tion can elect a desired candidate as the size of the manip- 
ulating coalition is varied. We demonstrated that a rescaled 
probability curve displays a simple universal form indepen- 
dent of problem size. Unlike phase transitions for other NP- 
complete problems, hard problems are not associated with 
this transition. Finally, we studied the impact of correlation 
between votes. We showed that manipulation is hard when 
votes are highly correlated and the election is "hung". How- 
ever, even one uncorrelated voter was enough to make manip- 
ulation easy again. 

What lessons can be learnt from this study? First, there ap- 
pears to be an universal form for the probability that a coali- 
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Figure 8: The impact of one random voter on the manipula- 
bility of a hung election. We plot the cost for the CKK al- 
gorithm to decide if a coalition of m agents can manipulate a 
veto election. Vetoes of the manipulators are weighted and 
uniformly drawn from (0, k], the non-manipulating agents 
have all vetoed the candidate that the manipulators wish to 
win, and the sum of the weights of the manipulators is twice 
that of the non-manipulators except for one random non- 
manipulating agent whose weight is uniformly drawn from 
(0, k']. When the veto of the one random voter has the same 
weight as the other voters, it is computationally easy to decide 
if the election can be manipulated. 



tion can manipulate the result. Can we derive this theoreti- 
cally? Second, whilst we have focused on the veto rule, simi- 
lar behavior is likely with other voting rules. It would, for in- 
stance, be interesting to study a more complex rule like STV 
which is NP-hard to manipulate without weights. Third, is 
there a connection between the smoothness of the phase tran- 
sition and problem hardness? Sharp phase transitions like that 
for satisfiability are associated with hard decision problems, 
whilst smooth transitions are associated with easy instances 
of NP-hard problems and with polynomial problems like 2- 
colorability. Fourth, these results demonstrate that empirical 
studies improve our understanding of manipulation. It would 
be interesting to consider simil ar studies for related prob- 
lems like preference elicitation I Walsh, 2007; Walsh, 2008 
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